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(54) incrementally calculated cut-plane region for viewing a portion of a volume data set in real* 
time 

(57) A volume rendering processor estat)lishes a 
cut-plane region of a volume data set, the cut-plane 
re^on t>eing defined by a plane equation and minimum 
and maximum distance values representing the values 
of the plane equation at outer faces of the cut-plane 
region. The plane equation is evaluated for each sample 
of the volume data, the result is compared with the min- 
imum and maximum distance values to determine 
whether the sample is in the cut-plane region, and the 
visibility of the sample is adjusted depending on the 
conrparison result. The plane equation is evaluated by 
continually accumulating the coefficient values in an 
order indicated by the ordering of the sequence of sam- 
ples. Evaluation logic includes an accumulator, a 2- 
input adder, registers for saving intermediate accumu- 
lated values in corresponding dimensions of the volume 
data, multiplexers for selecting the adder inputs from 
among the coeffident values, the output of the accumu- 
lator and the values in the registers, and visibility calcu- 
lation logic that adjusts the samples' visibility depending 
on the relationship between the output of the accumula- 
tor and the minimum and maximum distance values. In 
an inclusive operating mode, the visibility of the sample 
is set to zero if it is outside the cut-plane region, and in 
an exclusive mode the sample's visibility is set to zero if 
it ies in the cut-plane region. Falloff regions at each face 
of the cut-plane region are used to gradually adjust 
sample visibility to provide a smooth appearance. 
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Description 

CROSS REFERENCE TO RELATED APPLICAnON 
N/A 

5 

BACKGROUND OF THE INVENTKDN 

[0001] The present invention is related to the field of oonputer graphics, and in particular to volume graphics. 
[0002] Volume graphics is the subf ieid of computer graphics that deals with the visualization of objects or phenom- 

w ena represented as sampled data in three or more dimensions. These samples are called volume elements, or "voxels/ 
and contain digital information representing physical characteristtcs of the objects or phenomena being studied. For 
example, voxel values for a particular object or system may represent density, type of material, temperature, velocity, or 
some other property at discrete points in space throughout the interior and in the vicinity of that object or system. 
[0003] Volume rendering is the part of volume graphics concerned with the projection of volume data as two-dimen- 

15 sional images for purposes of printing, display on computer terminals, and other forms of visualization. By assigning 
colors and transparency to particular voxel data values, difierent views of the exterior and interior of an object or system 
can be dsplayed. For example, a surgeon needing to examine the ligaments, tendons, and bones of a human knee in 
preparation for surgery can utilize a tomographic scan of the knee and cause voxel data values conesponding to t)lood. 
skin, and muscle to appear to be completely transparent. The resulting image then reveals the condition of the liga- 

20 ments. tendons, bones, eto. whk:h are hidden from view prior to surgery, thereby allowing for better surgical planning, 
shorter surgical operations, less 8urgk»l exploration and faster recoveries. In another example, a mechanic using a 
tomographic scan of a turtxne blade or welded joint in a jet engine can cause voxel data values representing solid metal 
to appear to be transparent while causing those representing air to be opaque. This allows the viewing of internal flaws 
in the metal tfiat would otherwise be hidden from the human eye. 

25 [0004] Real-time volume rendering is the projecbon and display of volume data as a series of images in rapid suc- 
cession, typically at 30 frames per second or fiaster. This makes it possfole to aeate the appearance of moving pictures 
of the ok3ject. phenomenon, or system of interest. It also enables a human operator to interactively control the parame- 
ters of the projection and to manipulate the image, while providing to the user immediate visual feedback. It will be 
appreciated that projecting tens of millions or hundreds of millions of voxel values to an image requires enormous 

30 amounts of computing power. Doing so in real time requires substantially more computational power. 

[0005] Further background on volume rendering is included in a Doctoral Dissertation entitled "Achitectures for 
Real-Time Volume Rendering" submitted by Hanspeter PTister to the Department of Computer Science at the State Uni- 
versity of New Vbric at Stony Brook in December 1996, and in U.S. Patent #5,594.842, "Apparatus and Method for Real- 
time Volume Visualizatfon." Additional background on volume rendering is presented in a book entitled "Introduction to 

35 Volume Rendering" by Barthold Uchtenbelt. Randy Crane, and Shaz hJaqvi. published in 1998 by Prentfoe Hall PTR of 
Upper Saddle River, New Jersey 

[0006] The users of imaging systems generally need to view sections of an object For example, in applications 
such as medical, geological, industrial and other scientific appBcations it is known to display cross sectional data con-e- 
sponding to selected aoss sections of a scanned object, such as the brain, organs, etc. 
40 [0007] One known technique for displaying sections of a volume data set employs what are referred to as "dip 
planes". A clip plane is an imaginary plane intersecting the volume data set at a location and orientation defined by a 
dip plane equation established by volume rendering software. Sets of two or more dip planes can be defined in a man- 
ner such that only the region of the volume data set between dip planes is displayed. 

[OOOq However, the calculations that are associated with use of clip planes are processing-intensive. Further, the 
45 complexity of the calculations is in part a function of the orientation of the dip plane with respect to the vohjme data set. 
Conse(;^ently. real-time manipulation of a volume data set with dip planes is difficult to €u;hieve using presently known 
technkiues. 

[0009] It wouM be desirable to enable the display of arbifrary sections of an object represented by volume data with- 
out incurring substantiai processing penalties such as are entailed by the use of clip planes. 

$0 

BRIEF SUMMARY OF THE INVENTION 

[0010] In accordance with the present invention, a pipelined volume rendering processor is disdosed which is 
capable of displaying a slab-like sectfon of an object refenred to as a "cut-plane regfon*. The processing required to 
55 implement the cut-plane region is an inaemental additfon to the rendering pipeline, resulting in only a negligible impact 
on the throughput of the rendering processor. 

[001 1] bfi the (fisdosed rendering processor, a cut-plane regon is defined in terms of a single plane equation and 
a thickness. The plane equation is evaluated for each san^Dle of the volume data, and the result is compared with pre- 
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determined minimum and maximum values to determine whether the sample is inside or outside the cut-ptane region. 
In an inclusive mode, data points outside of the cut-plane region are cropped from the data set, so that only those data 
points inside remain visible. In an exclusive mode, data points inside the cut-plane region are cropped from the data 
set. The plane equation that desaibes the cut-plane region is evaluated as the data set is traversed in three orthogonal 
£ dimensions by continually accumulating values of the plane equation. Multiplication operations are avoided, so that the 
circuitry required to determine whether a sample is inside or outside the cut-plane region is simplified. Also, the evalu- 
ation and cropping operations are performed as further steps in a processing pipeline. The latency in the pipeline is 
incrementally increased, but rendering throughput is not affected. 

[0012] A smoothing function may be employed to enhance the view provided by the cut-plane region. In particular. 

10 the opacity of sanple points near the faces of the cut-plane region can be adjusted to provide a smooth appearance to 
the displayed image. Transition regions at each face of the cut-plane region are employed to select sample points for 
opacity adjustment. In the inclusive mode, the opacity value | ) of sample points that are outside of the cut-plane is set 
to zero. The opacity value ( ) of sanple points in the transition regions is adjusted by a conrection factor that ranges lin- 
early between zero and one depending upon the proximity of the sample point to the interior of the cut plane. In the 

15 exclusive mode, the opacity value of sample points in the transition regions is deaeased by a linear correction factor 
that ranges from one to zero in proportion to the proximity of the sample point to the interior of the cut-plane. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

20 [001 3] The foregoing features of this invention, as well as the invention itself, may be more fully understood from 
the following Detailed Description of the Invention, and Drawing, of which: 

Figure 1 is a diagrammatic illustration of a volume data set; 

Figure 2 is a diagrammatic illustration of a view of a volume data set being projected onto an image plane by means 
25 of ray-casting; 

Figure 3 is a cross-sectional view of the volume data set of Figure 2; 

Figure 4 is a diagrammatic illustration of the processing of an individual ray by ray-casting: 

Figure 5 is a block diagram of a pqDelined processing element for real-time volume rendering in accordance with 

the present invention; 

30 Rgure 6 is a diagram of a cut-plane region that is defined in relation to tiie volume data set of Fig. 1 : 
Figure 7 is a graph that illustrates exclusive mode cut-plane smoothing; 
Figure 8 is a graph that illustrates inclusive mode cut-plane smoothing; and 
Rgure 9 is a schematic diagram of control logic that implements the cut-plane functionality. 

35 DETAILED DESCRIPTION OF THE INVENTION 

[0014] Referring now to Figure 1 and by way of further background, a view of a three-dimensional volume data set 
1 0 is shown. Figure 1 depicts an array of voxel positions 1 2 ananged in the form of a rectangular solid. More particularly 
the voxel positions fill the solid in three dimensions and are uniformly spaced. The position of each voxel can be repre- 

40 sented in a coordinate system defined by the three axes 1 1 labeled X. Y and Z. Associated with each voxel position is 
one or more data values representing some characteristics of the object, system, or phenomenon under study, for 
example density, type of material, temperature, velocity, opacity or other properties at discrete points in space through- 
out the interior and in the vicinity of that object or system. It Is convenient to represent a volume data set in a computer 
as a three-dimensional array of values, with the value at array index position {X. Y, Z) corresponding to the volume data 

45 values at coordinates (X. Y Z) in three-dimensional space. 

[0015] Figure 2 illustrates an example of a volume data set 10 comprising an array of slices from a tomographic 
scan of the human head. A two-dimensional image plane 16 represents the surface on which a volume rendered pro- 
jection of the human head is to be displayed. In a technique known as ray-casting, rays 18 are cast from pixel positions 
22 on the image plane 16 through the volume data set 10, witii each ray accumulating color and opacity from tiie data 

so at voxel positions as it passes through the volume. In ttiis manner the color, transparency, and intensity as well as other 
parameters of a pixel are extracted from the volume data set as the accumulation of data at sanrple points 20 along the 
ray In this example, voxel values associated with bony tissue are assigned an opaque color, and voxel values associ- 
ated with all other tissue in the head are assigned a transparent color. Therefore, the result of accumulation of data 
along a ray and the attribution of this data to the corresponding pixel result in an image 19 in viewing plane 16 that 

55 appears to an observer to be an image of a ttiree-cfimensional skull, even though the actual skull is hidden from view 
by the skin and other tissue of the head. 

[0016] In order to appreciate more-fully the method of ray-casting. Rgure 3 depicts a two-dimensional cross-sec- 
tion of a three-dimensional volume data set 10 of Figure 2. The first and seoond dimensions carespond to the dimen- 
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sions illustrated on the plane of the page. The third dimension of volume data set 1 0 is perpendicular to the printed page 
so that only a cross section of the data set can be seen in the figure. Voxel positions are illustrated by dots 12 in the 
figure. The voxels associated with each position are data values that represent some characteristic or characteristics of 
a three-dimensional object 1 4 at fixed points of a rectangular grid in three-dimensi(»ial space. Also illustrated in Figure 
5 3 is a one-dimensional view of a two-dimensional image plane 16 onto which an image of object 14 is to be projected 
in terms of providing pixels 22 with the appropriate characteristics. In this illustration, the second dimension off image 
plane 16 is also perpendicular to the printed page. 

[0017] In the technique of ray*casting, rays 18 are extended from pixels 22 of the image plane 16 through the vol- 
ume data set 10. Each ray accumulates color, brightness, and transparency or opacity at sample points 20 along that 
10 ray. This accumulation of light determines the brightness and color of the corresponding pixels 22. Thus while the ray 
is depicted going outwardly from a pixel through the volume, the accumulated data can be thought of as being transmit- 
ted t>ack down the ray where it is provided to the corresponding pixel to give the pixel color, intensity and opacity or 
transparency, anwngst other parameters. 

[0018] It will be appreciated that although Figure 3 suggests that the third dimension of volume data set 1 0 and the 
15 second dimension of image plane 1 6 are both perpendicular to the printed page arxJ tfierefbre parallel to each other, in 
general tfUs is not the case. The image plane may have any orientation with respect to the volume data set so that rays 
18 may pass through the volume data set 10 at any angle in alt three dimensions. 

[001 9] It will also be appreciated that sample points 20 do not necessarily intersect the voxel 1 2 coordinates exactly. 
Therefore, the value of each sample point must be synthesized from the values of voxels nearby. That is, the intensity 

20 of light, color, and transparency or opacity at each sample point 20 must be calculated or interpolated as a mathemat- 
ical function of the values of nearby voxels 12. The re-sampling of voxel data values to values at sample points is an 
application of the branch of mathematics known as sampling theory. The sample points 20 of each ray 18 are then accu- 
mulated by another mathematical function to produce the brightness and color of the pixel 22 corresponding to that ray. 
The resulting set of pixels 22 forms a visual image of the object 14 in the image plane 16. 

25 [0020] Rgure 4 illustrates the processing of an individual ray Ray 18 passes through the three-dimensional volume 
data set 10 at some angle, passing nearorpossibly through voxel positions 12. and accumulates data at sample points 
20 along each ray The value at each sample point is synthesized as illustrated at 21 by an interpolation unit 103 (see 
Figure 5), and its gradient is calculated as illustrated at 23 by a gradient estimation unit 1 1 1 (see Rgure 5). The sample 
point values from sample point 20 and the gradient 25 for each sanple point are then processed in the pipeline to 

30 assign color, brightness or intensity, and transparency or opacity to each sample. As illustrated at 27. this is done via 
pipeline processing in which red. green and blue hues as well as intensity and opacity or transparency are calculated. 
FinaOy. the colors, levels of brightness, and transparencies assigned to all of the samples along aD of the rays are 
applied as illustrated at 29 to a compositing unit 1 24 that mathematically combines the sample values into pixels depict- 
ing the resulting image 32 for display on image plane 16. 

35 [0021] The calculation of the color, brightness or intensity and transparency of sample points 20 is done in two 
parts. In one part, a mathematical function such as trilinear interpolation is utilized to take the weighted average of the 
values of the eight voxels in a cubic arrangement immediately surrounding the sample point 20. The resulting average 
is then used to assign a color and opacity or transparency to the sample point by some transfer function. In the other 
part the mathematical gradient of the sample values at each sample point 20 is estimated by a method such as taking 

40 the differences between nearby sample points. It will be appreciated that these two calculations can be inplemented in 
either order or in parallel with each other to produce mathematically equivalent results. The gradient is then used In a 
lighting calculation to determine the brightness of the sample point. Lighting calculations are welhknown in the oonpu- 
ter gre^ics art and are described, for example, in the textbook "Computer Qraphk;s: Principles and Practice." 2nd edi- 
tion, by J. Fdey. A. vanDam. S. Feiner. and J. Hughes, published by Addison-Wesley of Reading. Massachusetts, in 

45 1990. 

[0022] Figure 5 depicts a block diagram of a pipelined processor appropriate for performing the calculations illus- 
trated in Figure 4. The pipelined processor comprises a plurality of pipeline stages, each stage of which holds one data 
element, so that a plurality of data elements are being processed at one time. Each data element is at a different degree 
of progress in its processing, and all data elements move from stage to stage of the pipeline in lock step. At the first 

50 stage of the pipeline, a series of voxel data values ftow into the pipeline at a rate of one voxel per cyde from the voxel 
memay 100. which operates under the control of an address generator 102. The interpolation unit 104 receives voxel 
values located at coordinates X. Y and Z in three-dimensional space, where X. Y and Z are each integers. The interpo- 
lation unit 104 is a set of pipelined stages that synthesize data values at sample points between voxels corresponding 
to positkms akxig rays that are cast through the volume. During each cycle, one voxel enters the interpolation unit and 

55 one interpolated sample value emerges. The latency between the time a voxel value enters the pipeline and the time 
that an interpolated sample value emerges depends upon the number of pipeline stages and the internal delay in each 
stage. 

[0023] The interpolation stages of the pipeline comprise a set of interpolator stages 104 and three FIFO elements 
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106. 108. 110 tor recirculating data through the stages. In the current embodiment, these are all linear interpolations, 
but other interpolation functions such as cubic and UGrangian nnay also be employed. In the illustrated enft>odiment. 
Interpolation is performed in each dimension as a separate stage, and the respective FIFO elements are included to 
recirculate data for purposes of interpolating between voxels that are adjacent in space but widely separated in the time 

5 of entry to the pipeline. The delay of each FIFO is selected to be exactly the amount of time elapsed between the read- 
ing of one voxel and the reading of an adjacent voxel in that particular dimension so that the two can be combined in an 
interpolation function. It will be appreciated that voxels can be streamed through the interpolation stage at a rate of one 
voxel per cycle with each voxel being combined with the nearest neighbor that had been previously recirculated through 
the FIFO associated with that dimension. 

w [0024] Three successive interpolation stages, one for each dimension, are concatenated and voxels can pass 
through the three stages at a rate of one voxel per cycle at both input and output. The throughput of the interpolation 
stages is one voxel per cycle independent of the number of stages within the interpolation unit and independent of the 
latency of the data within the interpolation unit and the latency of the recirculation stages within that unit. Thus, the inter- 
polation unit converts voxel values located at integer positions in XYZ space into sample values located at non-integer 

IS positions at the rate of one voxel per cycle. In particular, the interpolation unit converts values at voxel positions to val- 
ues at sample positions disposed along the rays. 

[0025] Following the interpolation unit 104 is a gradient estimation unit 112. which also comprises a plurality of 
pipelined stages and recirculation FIFOs. The function of the gradient unit 1 12 is to derive the rate of change of the 
sample values in each of the three dimensions. The gradient estimation unit operates in a similar manner to the inter- 

20 potation unit 104 and conputes the rate of change of the sanple values in each of the three dimensions. Note, the gra- 
dient is used to determine a normal vector for illumination, and its magnitude may be used as a measure of the 
existence of a surface when the gracfient magnitude is high. In the present embodiment the calculation is obtained by 
taking central differences, but other functions known in the art may be employed. Because the gradient estimation unit 
is pipelined, it receives one interpolated sample per cycle, and it outputs one gradient per cycle. As with the interpola- 

25 tion unit, each gradient is delayed from its con'esponding sample by a number of cydes whk;h is equal to the amount 
of latency in the gradient estimation unit 112 including respective recirculation FIFOs 114. 1 16. 118. The delay for each 
of the recirculation FIFOs is determined by the length of time needed between the reading of one interpolated sample 
and nearby interpolated samples necessary for deriving the gradient in that dimension. 

[0026] The interpolated sample and its corresponding gradient are concurrently applied to the classification and 

30 illumination units 1 20 and 1 22 respectively at a rate of one interpolated sample and one gradient per cycle. Giassif ica- 
tk)n unit 120 serves to convert interpolated santple values into colors in the graphics system; i.e.. red. green, blue and 
alpha values, also known as RGBA values. The red. green, and t)lue values are typically fractions between zero and 
one inclusive and represent the intensity of the color component assigned to the respective interpolated sample value. 
The alpha value is also typically a fraction between zero and one inclusive and represents the opacity assigned to the 

35 respective interpolated sample value. 

[0027] The gradient is applied to the illumination unit 1 22 to modulate the newly assigned RGBA values by adding 
highlights and shadowvs to provide a more realistic image. Methods and functions for performing illumination are well 
known in the art. The illumination and classification units accept one interpolated sample value and one gradient per 
cycle and output one illuminated color and opacity value per cycle. 

40 [0028] Although in the current embodiment, the interpolation unit 104 precedes the gradient estimation unit 1 12, 
which in turn precedes the classification unit 120. it will be appreciated that in other embodiments these three units may 
be arranged in a different order. In particular, for some applications of volume rendering it is preferable that the classi- 
fication unit precede the interpolation unit. In this case, data values at voxel posittons are converted to RGBA values at 
the same positions, then these RGBA values are interpolated to obtain RGBA values at sample points along rays. 

45 [0029] The compositing unit 1 24 combines the illuminated color and opacity values of all sample points along a ray 
to form a final pixel value corresponding to that ray for display on the computer terminal or two-dimensional image sur- 
face. RGBA values enter the compositing unit 124 at a rate of one RGBA value per cycle and are accumulated with the 
RGBA values at previous sample points along the same ray. When the accumulation is complete, the final accumulated 
value is output as a pixel to the display or stored as image data. The conrpositing unit 124 receives one RGBA sample 

so per cycle and accumulates these ray by ray according to a compositing function until the ends of rays are reached, at 
which point the one pixel per ray is output to torm the final image. A number of different functions well known in the art 
can be employed in the compositing unit, depending upon the application. 

[0030] Between the illumination unit 122 and the compositing unit 124. various modulation units 126 may be pro- 
vided to permit modification of the illuminated RGBA values, thereby modifying the image that is ultimately viewed. One 
55 such nrKxiulation unit is used for aopping the sample values to permit viewing of a restricted subset of the data. Another 
modulation unit provides a function to show a slice of the volume data at an arbitrary angle and thickness. A third mod- 
ulation unit provides a three-dimensional cursor to allow the user or operator to identify positions in XYZ space within 
the data. Each of the above identified functions is implemented as a plurality of pipelined stages accepting one RGBA 
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value as input per cyde and emitting as an output one modulated RGBA value per cycle. Other modulation functions 
may also be provided wtiich may (ikewise be imptemented within the pipelined architecture herein desaibed. The addi- 
tion of the pipelined modulation functions does not diminish the throughput (rate) of the processing pipeline in any way 
but rather affects the latency of the data as it passes through the pipeline. 

5 [0031] In order to achieve a real-time volume rendering rate of. for example. 30 frames per second for a volume 
data set with 256 x 256 x 256 voxels, voxel data must enter the pipelines at 256^ x 30 frames per second or approxi- 
mately 500 million voxels per second. It will be appreciated that although the calculations associated with any particular 
voxel involve many stages and therefore have a specified latency, calculations associated with a plurality of different 
voxels can be in progress at once, each one being at a different degree of progression and occupying a different stage 

10 of the pipeline. This makes it possible to sustain a high processing rate despite the oonplexity of the calculations. 
[0032] It will be further appreciated that the above described pipelined processor can be replicated as a plurality of 
parallel pipelines to achieve higher throughput rates by processing adjacent voxels in parallel. The cycle time of each 
pipeline is determined by the number of voxels in a typical volume data set nrultiplied by the desired frame rate, and 
divkJed by the number of pipelines. In a preferred embodiment, the cyde time is 7.5 nanoseconds and four pipelines 

15 are emptoyed in parallel. 

[0033] Referring now to Figure 6» a planar volumetric cut-plane region 1 50 is employed to crop the volume data 1 0 
to provide a desired view. In an inclusive mode, only the samples that reside within the cut-plane region 1 50 are visible. 
In an exclusive mode, the sairples that reside within the cut-plane region 1 50 are not visible. In other words, either the 
sample points that are outside of the cut-plane region 150 or the sample points that are inside of the cut-plane regksn 

20 1 50 are cropped from the displayed view. Samples are cropped by setting their opacity value ( ) to zero, where the sym- 
bol " * refers to the afbrementoned "al^ha" or "A" component in an RGBA color system. This cropping of sanrples is 
performed within one of the modulation units 126 In the pipeline shown in Figure 5. As a result, while the aopping 
results in additional latency in the pipeline, it has a negligible effect on the throughput of the rendering process. 
[0034] In the illustrated erribodiment. the set of samples included within the cut-plane regton 1 50 are defined by the 

25 fblkMving relatk)n: 



30 



where A, B and C define the direction normal to the cut-plane region 150. and D^n and O^^ix are the distances from 
the origin to the faces 152 and 154 respectively in the directran of the normal. Hence. D^in < D^ax. and the thickness 
35 of the cut-plane region 150 is Omax " Dmin- It shouW be noted that A, B. C. and D^, may be either positive or neg- 
ative values. 

[0035] Whether individual sample points reside inside or outskle the cut-plane region 1 50 is determined by evalu- 
ating the expression L(x,y.z) » Ax + By + Cz at each sample point and comparing the result with D^^ and D^^. If 
L(x.y.2) is less than O^ip or greater than the sample is outside of the cut-plane region 1 50. Othenwise. the sanple 

^ Sx,y,z is inskJe the cut plane region 1 50. 

[0036] Refen-ing to Fig. 7. the opacities of sample points near the faces 152 and 154 of the cut-plane region 150 
are adjusted to provide a smooth appearance to the displayed image. Transition regions 1 56. 1 58 at each f^ce 1 52. 1 54 
of the cut-plane region 1 SO are defined in which the opacities of the sample points are progressively adjusted. The widtti 
Dfaiioff Of the transition regkms 156. 158 is defined such ttiat 0^^^ > 0 and 0^^ + D^itotf < D^^x Whether individual 

45 sample points reside insWe eittier transitkm regran 1 56 or 1 58 is determined by comparing L(x.y,z) with the D values for 
the transition regions 156 and 158. If Dn,in ^ Mx.y.z) < D^jn + D,aiioff then sample S^.y.^ is positioned in the transition 
region 156. If D„^ax ^ Mx.y,2) :S D^ax + Dtaiioft then sample S^ ^^ is positioned in ttie transition region 158. If + D,aiiotf 
^ L(x.y.z) £ then the sample Sx.y.z is positioned within the cut-plane region 150 but not in either of the transition 
regions 156 or 158. 

so [0037J Each sample point has an associated opacity value Osa^pje- In the inclusive mode, the opacity values Ogam- 
pia of sample points that are outside of the cut-plane regkjn 150 are set to zero. The opacity values a^jr^ of sample 
points in the interior of the cut-plane region 1 50 are not changed The opacity value asampie associated with each sam- 
ple point in a transition region 156. 1 58 is adjusted depending on the positon of the sample. In the inclusive mode, the 
opacity values of sample points in the transition regions 1 56. 158 are adjusted by a linear con-ection factor that ranges 

55 from zero to one in proportion to ttie proximity of the sample point to the interior of the cut-plane region 1 50. The opacity 
values of sanr^e points that are positioned in ttie transition region 156 nearer to distance D^jn from the origin are 
adjusted in accordance witti Eq. 2 below: 
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The opacity values of sample points that are positioned in the transition region 158 nearer to distance Omax ^om the 
origin, are adjusted in accordance with Eq. 3 below: 



[0038] Relerring to Fig. 8. in the exclusive mode the opacity values of sample points in the transition regions 156. 
1 58 are adjusted by a linear correction factor ranging from one to zero in proportion to the proximity of the sample point 
to the interior of the cut-plane region 150. in the illustrated embodiment, the opacity values of samples that are posi- 
tioned in the transition region 156 nearer to distance 0,^;,, from the origin are adjusted in accordance with Eq. 4 below: 



The opacity values of samples that are positioned in the transition region 158 nearer to distance Oj^^^ from the origin 
are adjusted in accordance with Eq. 5 below: 



The opacity values of sample points that are positioned in the interior of the cut-plane region 1 50 but not in a transition 
region are set to zero. The opacity values of sample points that are not in the cut*plane region 150 are not changed. 
[0039] Although in the illustrated embodiment the same linear adjusting function is used in both transition regions 
156 and 158. it will be appreciated that in alternative embodiments different adjustment functions may be employed, 
and it may be desirable to use different adjustment functions in the separate transition regions 156 and 158. 
[0040] In the illustrated embodiment, the value of L(x.y.2) is evaluated incrementally as samples flow through the 
modulation unit 126. That is. the expression L(x ^. y ^, z J a x ^ -»> y j -f z ^ is evaluated by adding a constant to a previous 
value of L(Xi.v yj. z^). L(Xi. 2^^) or L(X|, yj.^, z^). Consequently, multipncatlon operations are avoided, so that the cir- 
cuitry required to evaluate the sample point distance is reduced. 

[0041 ] Assume lor the moment that samples are spaced one unit of distance apart in each dimension. Then the 
value of L(x<f 1 , y. z) is given by: 






A(x-i-l) By Cz s Ax <f By Cz > A. 



that is. L(x. y. z) -f A. for any sample point at position (x.y.z). Ukewise. 



L(x. y-i-1.z)sL(x. y. z)-f B 
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L(x. y. z-i-1)sL(x,y, z)-f C 

Therefore. H samples are spaced one unit apart in each dimension, then in order to calculate the next value in any direc- 
tion it is sufficient to simply add the dimensional coefficient of the cut plane equation to the value of the cut plane equa- 
5 tion in the previous sample position in that dimension. 

[0042] More generally, suppose that samples are organized in uniformly spaced slices perpendicular to the z-axis. 
such that the slices are distance z^xep apa^t. Suppose further that each slice is organized into rows that are distance 
ystep apart, and finally that within each row. samples are spaced a distance x^^p apart. Then the value of L(Xi^, , y.. z J 
can be calculated inaementally from the value of Ux^. yj. Z|^) as: 

10 

MXi^vyi.2k)=Ax^i+Byj + CzH 
«A{Xi + Xs,^)+ By^ + Cz^ 
«AXj + Byj+Cz„ + Ax5,^ 
= MXi.yj.z^) + Ax5,^ 



for any y, and z^. Likewise, the value of L(xi. y^^i . z^) can be calculated incrementally from the value of L(Xi. y^. z^) as: 

L(*ryH.2^)»AX| + Byj^i +C2„ 
aA3(j + B(yj + ys,^)+ Cz^ 
aAX| + Byj + Cz^ + By5,gp 
-L(x,.y^.z^) + Bys,ep 



25 for any Xj and zk- By the same method, the value of t^Xj. yj. z^^^ ) can be calculated inaementally from the value of L(Xj. 
Vj. Zk) as: 

M^i'yj.Zfc^ij'AXj + By^ + Cz,^, 
«AX| + Byj + C(z^ + Z3,^) 

=AXi + Byj + CzK + Cz^,ep 
*L(Xj.yj.Zh) + Cz«^ 

for any x^ and yj. 

35 [0043] It will be appredated that to calculate the value of L(x,y,z) for any sample at position (x.y.z), it is suff'cient to 
start with an initial value, then incrementally calculate the polynomial L for all samples to the left, above, and in front of 
sample (x.y.z). Because the volume data is traversed in an orderly tohion left to right, top to bottom, and front to back, 
the value of L(x.y.z) can be cateulated at each sample point during the traversal. It will also be appreciated that in other 
embodiments, the volume data set may be traversed in different orders, but nevertheless the expression L(x,y.z) can be 

40 calculated in an incremental fashion during the traversal. 

[0044] Rgure 9 illustrates a circuit used in a modulatkxi unit 126 of a processing pipeline for the purpose of adjust- 
ing the visibility of samples inskie and outskie of the cut-plane region 1 50 in accordance with the above Equations (2) 
- (5). The value of L(xo. yo. zq) at the first sample point (xo. yo. zq) of the traversal of the volume is given as an input 
value labeled initialValue. that is, 

45 

initialValue = Axq + Byg > Czq. 

[0045] The sample position (xq, yo. zo) is not necessarily the origin of the volume data set. but merely the first sam- 
ple accumulated atong the first ray to be processed. The initialValue is provided to a multiplexer 160 to be loaded into 

so an accumulator 162. As desaibed below, the accurrtulator 162 is used to continually re-evaluate the expression 
L(x.y.z) = Ax ♦ By + Cz representing the sample distance from the origin in the directiori of the cut-plane region 150. 
The initialValue is also loaded into registers labeled saveX 172 and saveY 174. used in a manner described below. A 
subsequent value is loaded into register saveZ 1 76 at a later time, also as described below. Input values A^. B^dj. and 
Cadj. input by control software are respectively equal to the values Ax^^ By^tep. and Cze,ep shown in the equations 

55 abova 

[0046] For each new sample, the accumulator 162 is loaded with the sum of the outputs of multiplexers 166 and 
168 as calculated by an adder 170. The control logic first steps in the X direction by repeatedly adding the contents of 
the accumiiator 162 to the Agdj coefficient and reloading the accumulator 162 via multiplexer 160. When the end of a 
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row is reached and a new row begun, the distance for sample (0.1 .0) is computed by adding the B^^^ coefficient to the 
contents of the saveX register 1 72. into which had been previously stored the distance for sample (0.0.0). At the same 
time, this calculated distance for sample (0. 1 .0) is stored in the saveX register 1 72 to be used at the beginning of the 
next row. This sequence is repeated for each row in a slice. 

£ [0047] When the end of a slice is reached and a new slice begun, the distance for samfrie (0,0,1) is computed by 
adding the Cadj coefficient to the contents of the saveY register 174. into which had been previously stored the distance 
for sample (0.0.0). At the same time, this calculated distance for sample (0.0.1) is stored in the saveY register 174 to 
be used at the beginning of the next slice. This sequence is repeated for each slice in a section. 
[0048] In the present embodiment, the volume data set is processed in sections. That is. the volume data set is par- 

10 titioned into sections of a predetermined size along the X axis, and all rays in all slices of a section are processed before 
any rays of any sbce of a sut^equent section. In Rgure 9. register 176 labeled saveZ contains the distance of the last 
sample in the first row of the first slice of a section, so that the distarx:e of the first sample of the next section can be 
obtained. In other words, let (xiast. yo* zo) represent the coordinates of the last sample of the first row of the first slice of 
the first section. When the distance Uxi^st. yo. Zo) is calculated by adder 170. it is stored in the saveZ register 176 as 

ts well as being passed to multiplexer 160. At the beginning of the next section, the value stored in the saveZ register 1 76 
is selected by multiplexer 166. and the adder 1 70 adds the value Aa^j to obtain the distance ol the first sample of that 
new section. This process is repeated at the end of the first row of the new section, so that a new value is stored in the 
saveZ register 1 76 for the subsequent section. 

[0049] The value in the accumulator 162 represents the distance L(x.y.z) of each sample (x.y.z) from the cut plane. 
so as that sample is processed. This value is coupled to a visibility calculator 1 64. which computes an 8-bit visibility factor 
for each sample based upon Drnjn. ^max» DtaDott* sample distance as it exists in the accunmjiator 162. In partic- 

ular, the visibility calculator 1 64 implements Equations (2) • (5) to determine a final value of the opadty () of the sample 
point. 

[0050] Figure 9 and the accompanying text akx)ve describe functionally how the expression Ax -i- By + Cz is repeat- 
25 ediy evaluated. In embocfiments using parallel processing elements it may be desirat)le to calculate several visibility val- 
ues simultaneously. This can be readily accomplished by straightlbnivard extension of the logic shown in Rgure 9. For 
example, several visibility calculators can be employed, each one receiving a corresponding distance which may be 
provided by a separate accumulator or derived from the distance in a single accumulator. If a single accumulator is 
used, it is necessary to step the accumulator by a scaled value representing the degree of parallelism. For example, if 
30 4 calculations are performed simultaneously in the X direction, accumulator 162 is stepped in increments of 4Aadj. The 
accumulated value represents the distance of the sample being processed by the left most or "zeroth" pipeline. Offsets 
of 1 Aadj. 2Aadj. and are added to the value in accumulator 162 to obtain the distances of the corresponding sam- 
ples in the adjacent three pipelines. 

[0051] It will be appreciated that the circuit of Figure 9 and the foregoing desatption represents a modulation unit 
35 126 in one or more processing pipelines for projecting a volume data set onto a two-dimensional image plane. Just as 
each pipeline is capable of accepting one voxel per cycle accumulating the RGBA value of a sample point during each 
sample, so the cut-plane modulation stage is also capable of determining the visibiOty of one sample during each cycle. 
Therefore, the addition of the cut-plane modulation stage to a processing pipeline does not reduce the throughput of 
the pipeline but only increases the latency by the length of time needed to add and accumulate values as shown in Rg- 
40 ure 9. Typically this latency is one cycle or a very small number of cycles. Therefore, the visibility testing of the cut-plane 
equation can be completed in real-time. 

[0052] Although in the foregoing desaiption the use of a single cut-plane region 1 50 is described, it may be desir- 
able in alternative embodiments to employ multiple cut-plane regions to achieve greater flexibility in the presentation of 
volume data. Also, a cut-plane region may be used in conjunction with other cropping techniques to enable an even 
45 wider variety of presentations. 

[0053] Emkxxliments consistent witii tiie present invention having been descrbed, other embodiments and varia- 
tions consistent with the present invention will be apparent to those skilled in the art Therefore, the invention should not 
be viewed as limited to the disclosed embodiments but rattier should be viewed as limited only by the spirit and scope 
of the appended claims. 

so 

Claims 

1 . Apparatus for nxxiifying a volume data set in real-time to display a cut-plane-modified version thereof, the appara- 
tus comprising a pipelined volume data processor including cut-plane control logic operative to perform the steps 
55 of: 

establishing a cut-plane region of the volume data set, tiie cutislane region being defined by a set of coeffi- 
cients of a plane equation and minimum and maximum distance values respectively representing the value of 
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the plane equation at two paraOet opposing outer faces of the cut-plane region; and 
for each of a sequence of samples of the volume data set. performing the steps of: 

(I) evaluating the plane equation for the coordinates of the sample; 
5 (ii) comparing the result of the evaluating step with the minimum and maximum distance values to deter- 

mine whether the sample lies in the cut-plane region; and 

(iii) adjusting the visibility of the sample depending on whether the sample is determined to lie in the cut- 
plane region. 

10 2. Apparatus according to daim 1 . wherein the volume data processor compnses one or more processing pipelines 
each including a plurality of pipelined processing elements, and wherein the cut-plane control logic is included 
within a processing element in some or ail of the processing pipelines. 

3. Apparatus according to claim 1 . wherein the sequence of samples result from scanning the volume data along sep* 
15 arate dimensions, and wherein the cutiilane control logic is operative during the step of evaluating the plane equa- 
tion to continually accumulate the values of the cut-plane equation in an order indicated by the ord^ing of the 
samples in the sequence. 

4. Apparatus according to claim 3. wherein the cut-plane control logic comprises: 

30 

an accumulator operative to continually accunrtulate distance values respectively associated with correspond- 
ing ones of the sequence of samples; 

a 2-input adder operative to generate a sum to be loaded into the accumulator; 

a first selector operative to select among coefficient values defining the cut-plane region, the output of the first 
2S selector being provided to one input of the adder; 

a set of registers operative to be loaded from the adder to save respective intermediate accumulated values in 
corresponding dimensions of the volume data: 

a second selector operative to select among a set of inputs including the output of the accumulator and the 
saved values in the registers, the output of the second selector being provided to the cAher input of the adder; 
30 and 

visibility calculation logic operative in response to the minimum and maximum distance values arKi the output 
of the accumulator to generate values used to adjust the visibility of the samples. 

5. Apparatus according to claim 1 operative in either an inclusive or exclusive mode, wherein the cut-plane control 
35 logic is operative during the visibility-adjusting step to set the visibility of the sample to zero if either (i) the appara- 
tus is operating in the exclusive mode and the sample is determined to lie in the cut-plane region, or (ii) the appa- 
ratus is operating in the inclusive mode and the sample is determined to He outside the cut-plane region. 

6. The apparatus of claim 1 wherein the cut-plane control logic is further operative to perform the step of establishing 
40 a falloff region at each face of the cut-plane region, each falloft region being defined by a respective falloff distance 

value, and wherein the comparing step comprises the step of comparing the result of the evaluating step with the 
minimum, maximum and falloff distance values to determine whether the sample lies in a falloff region, and wherein 
the visibility-adjusting step comprises the step of applying a linear correction factor to the visibility of the sample if 
the sample is in a falloff region, the carection factor ranging from one to zero depending on the location of the sam- 
45 pie in the falloff region. 

7. A method of modifying a volume data set in real-time to display a cut-plane-modified version thereof, comprising 
the steps of: 

so establishing a cut-ptane region of the volume data set. the cut-plane region being defined by a set of coeffi- 

cients of a plane equation and minimum and maximum distance values respectively representing the value of 
the plane equation at two parallel Ofsposing outer faces of the cut-plane region; and 
for each of a sequence of samples of the volume data set, performing the steps of: 

55 (i) evaluating the plane equation for the coordinates of the sample: 

(ii) comparing the result of the evaluating step with the minimum and maximum distance values to deter- 
mine whether the sample lies in the cut-plane region; and 

(iii) adjusting the visbility of the sample depending on whether the sample is determined to lie in the cut- 
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plane region. 

A method according to da'tm 7. wherein the sequence of samples result from scanning the volume data along sep- 
arate dimensions, wherein the step of evaluating the plane equation comprises the step of continually accumulating 
the values of the cut-plane equation in an order indicated by the ordering of the samples in the sequence. 

A method according to claim 7 executable in either an inclusive or exclusive mode, and wherein the visibility-adjust- 
ing step comprises the step of setting the visibility of the sample to zero if either (i) the method is being executed in 
the exclusive mode and the sample is determined to lie in the cutisiane region, or (ii) the method is being executed 
in the inclusive mode and the sample is determined to lie outside the cuti3lane region. 

The method of claim 7, further compci&nQ the step of establishing a lalloff region at each face of the cut-plane 
region, each l^loff region being defined by a respective falloff distance value, and wherein the oonparing step com- 
prises the step of comparing the result of the evaluating step with the minimum, maximum and falloff distance val- 
ues to determine whether the sample lies in a falloff region, and wherein the visibility-adjusting step comprises the 
step of applying a linear correction factor to the visibility of the sample if the sample is in a falloff region, the correc- 
tion factor ranging from one to zero depending on the location of the sample In the falloff region. 

A method according to claim 7, wherein the cut-plane region is a first cut-plane region defined by a first set of coef- 
ficients of a first plane equation emd first minimum and maximum distance values, and further comprising the steps 
of: 

establisNng one or more additional cut-plane regions of the volume data set. each additional cut-plane region 
being defined by a corresponding set of coefficients of a corresponding plane equation and carespondng min- 
25 imum and maximum distance values respectively representing the value of the corresponding plane equation 

at two parallel opposing outer faces of the cut-plane region; and 

for each of a sequence of samples of the volume data set and each additional cut-plane region, performing the 
steps of: 

30 (i) evaluating the plane equation for the coordinates of the sample; 

(ii) comparing the result of the evaluating step with the minimum and maximum distance values to deter- 
mine whether the sample lies in the cut-plane region; and 

(iii) adjusting the visibility of the sample depending on whether the sample is determined to lie in the cut- 
plane region. 

35 
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exclusive mode the sample's visibility is set to zero if it 
hes in the cut-plane region. Falloff regions at each face 
of the cut-plane region are used to gradually adjust sam- 
ple visibility to provide a smooth appearance. 
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